Fifteen Problems about the Mapping Class 
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Let 5 be a compact orientable surface, possibly with boundary. We de- 
note by Mod^ the mapping class group of S, i.e. the group 7ro(Diff (S*)) of 
isotopy classes of diffeomorphisms of S. This group is also known as the 
Teichmiiller modular group of S, whence the notation Mod^. Note that we 
include the isotopy classes of orientation-reversing diffeomorphisms in Modg, 
so our group Mod^ is what is sometimes called the extended mapping class 
group. 

For any property of discrete groups one may ask if Mod^ has this property. 
Guidance is provided by the analogy, well-established by now, between the 
mapping class groups and arithmetic groups. See, for example, |ri] or jTT] 
for a discussion. 

After the 1993 Georgia Topology Conference, R. Kirby was preparing 
a new version of his famous problem hst in low- dimensional topology. In 
response to his appeal, I prepared a list of ten problems about the mapping 
class groups, which was informally circulated as a preprint Some of 

these problems ended up in Kirby's list [KL in a somewhat modified form, 
some did not. In the present article I will indicate the current status of these 
problems and also will present some additional problems. Only Problems 4,6, 
and 9 of the original list of ten problems are by now completely solved. (For 
the convenience of the readers familiar with [l5] I preserved the numbering 
of these ten problems.) 

I tried to single out some specific questions, leaving aside such well-known 
problems as the existence of finite dimensional faithful linear representations 
or the computation of the cohomology groups. 



Supported in part by the NSF Grants DMS-9401284 and DMS-0406946. 



1 



1. The Congruence Subgroups Problem. This is Problem 2.10 in 
Kirby's list. 

Suppose that 5* is closed. Recall that a subgroup F of a group G is 
called characteristic if F is invariant under all automorphisms of G. If F is 
a characteristic subgroup of 7ri(5'), then there is a natural homomorphism 
Out(7ri(5')) Out(7ri(5')/F), where for a group G we denote by Out(G) the 
quotient of the group Aut(G) of all automorphisms of G by the (automatically 
normal) subgroup of all inner automorphisms. Clearly, if F is of finite index 
in 7ri(5'), then the kernel of this homomorphism is also of finite index. Note 
that any subgroup of finite index in a finitely generated group (in particular, 
in 7ri(S')) contains a characteristic subgroup of finite index. Since by the 
Dehn-Nielsen theorem Modg is canonically isomorphic to Out (711(5*)), our 
construction gives rise to a family of subgroups of finite index in Mods. By 
analogy with the classical arithmetic groups we call them the congruence 
subgroups. 

Conjecture. Every subgroup of finite index in Mod^ contains a congru- 
ence subgroup. 

V. Voevodsky had indicated (in a personal communication) a beauti- 
ful application of this conjecture. Namely, the conjecture implies that a 
smooth algebraic curve over Q is determined up to isomorphism by its al- 
gebraic fundamental group (which is isomorphic to the profinite completion 
of TTi{S)) considered together with the natural action of the absolute Galois 
group Gal(Q/Q) on it. This corollary was apparently first conjectured by 
A. Grothendieck. I am not aware of any publication where this conjecture of 
Grothendieck is deduced from the solution of the congruence subgroup prob- 
lem for the mapping class groups. The Grothendieck conjecture itself was 
proved by S. Mochizuki |Molj after the initial work by A. Tamagawa [Famj . 
See also |Mo3j and the expository accounts by S. Mochizuki |Mo2j and G. 
Faltings jFj. The proof of the Grothendieck conjecture lends some additional 
credibility (beyond the analogy with the classical congruence-subgroup prob- 
lem) to the above congruence subgroup conjecture. 

2. Normal Subgroups. This is Problem 2.12 (B) in Kirby's list. 
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If a subgroup F of tti{S) is characteristic, then the kernel of the natural 
homomorphism Out(7ri(S')) Out(7ri(S')/r) from the Problem 1 is a nor- 
mal subgroup of Out(7ri(S')). So, this construction gives rise to a family of 
normal subgroups of Mods. In general, these subgroups have infinite index. 
For example, the Torelli subgroup is a subgroup of this type. 



Question. Is it true that any normal subgroup is commensurable with such 
a subgroup? 

Recall that two subgroups Fi and F2 of a group G are commensurable if 
the intersection Fi fl F2 has finite index in both Fi and F2. 
This problem was suggested by a discussion with H. Bass. 

3. Normal Subgroups and pseudo-Anosov Elements. This is Prob- 
lem 2.12 (A) in Kirby's list. 



Question. Is it possible that all nontrivial elements of a normal subgroup 
of Mods are pseudo-Anosov? 

To the best of my knowledge, this question was posed independently by 
D. D. Long, J. D. McCarthy, and R. C. Penner in the early eighties. I learned 
it from R. C. Penner in 1984. 

Moderate progress in the direction of the solution of this problem is due to 
K. Whittlesey [jWhij . who constructed examples of such subgroups in the case 
of spheres with 5 or more punctures and for closed surfaces of genus 2 (in the 
latter case the mapping class group is well-known to be intimately connected 
with the mapping class group of the sphere with 6 punctures) . Unfortunately, 
there is, apparently, no hope of extending the method of proof to the other 
cases, especially to the closed surfaces of higher genus (which were the focus 
of all previous attempts at this problem, I suspect). 

4. Conjecture (Mostow-Margulis superrigidity). This is Problem 
2.15 in Kirby's list. 
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Conjecture. IfT is an irreducible arithmetic group of rank > 2, then every 
homomorphism T Mod5 has finite image. 

For many arithmetic groups F the conjecture can be proved by com- 
bining some well-known information about arithmetic groups with equally 
well-known properties of Mod^. But, for example, for cocompact lattices 
in SU{p, q) this straightforward approach seems to fail. (I owe this specific 
example to G. Prasad.) In any case, by now this conjecture is completely 
proved. 

V. A. Kaimanovich and H. Masur |KaMj proved that so-called non- 
elementary subgroups (subgroups containing a pair of pseudo-Anosov ele- 
ments with disjoint sets of fixed points in the Thurston boundary) of Modg 
are not isomorphic to irreducible arithmetic groups of rank > 2. The proof 
is based on the theory of random walks on Mods developed by Masur and 
Kaimanovich-Masur and on the results of H. Furstenberg about random 
walks on arithmetic groups (see the references in |KaMj ) . If combined with 
the Margulis finiteness theorem and the techniques of [HI , this result can be 
used to prove the conjecture. 

A proof close in the spirit to the one alluded to in the previous paragraph 
is due to B. Farb and H. Masur |FMj . 

In addition, S-K. Yeung [Yj completed the picture by proving that any 
homomorphism from a lattice F in either Sp(m, 1) or F^"^^ (the isometry 
group of the Cayley plane) into a mapping class group has finite image. The 
lattices in the remaining simple Lie groups of rank 1 often admit non-trivial 
homomorphisms to Z, and, therefore, homomorphisms to the mapping class 
groups with infinite image. 

5. Dehn multitwists. For a nontrivial circle a on 5* (i.e. a submanifold 
a of 5 diffeomorphic to the standard circle S^) let us denote by t^ the (left) 
Dehn twist along a; ta G Mods. A Dehn multi-twist is any composition of 
the form t^^ o t^^ o ■ ■ ■ o t^^ for disjoint circles ai, ■ ■ ■ , an- 

Question. Is there a constant Ns, depending only on S, such that the fol- 
lowing holds ? Let f G Mods o,nd let t = t^^ o t^^ o ■ ■ ■ o t^^^ be a Dehn 
multi-twist. If A = {/™(aj) : 1 < i < n, m G Z} fills S (i.e. for any non- 
trivial circle 7 there exists an a & A such that the geometric intersection 
number 1(7, a) ^ 0), then only a finite number of elements of the form P o 
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j G Z, are not pseudo-Anosov, and the corresponding j are among some Ns 
consecutive integers. 

By a theorem of A. Fathi |Fathj . if t is a Dehn twist, then this is true for 
Ns = 7. This theorem of A. Fathi was preceded by a theorem of D. Long and 
H. Morton |LM] to the effect that for a Dehn twist t, only a finite number of 
element P o / are not pseudo-Anosov under the above assumptions, without 
a uniform bound on the number of exceptions. 

A weaker version of this question is still interesting: under the same 
conditions, is it true that no more than Ns of P o / are not pseudo-Anosov? 

The initial motivation for this question was that a positive answer would 
allow to prove the Conjecture 4 in some nontrivial cases. This motivation is 
now (completely?) obsolete, but I still consider this question to be interest- 
ing. I believe that Fathi's paper jFathj is one of the deepest and the most 
underappreciated works in the theory of the mapping class groups. In fact, 
I am aware of only one application of his results: the author's theorem [l2] 
to the effect that the mapping class groups have rank 1 in an appropriate 
sense (note that the Long-Morton theorem is not sufficient here); see |T7] . 
Section 9.4 for a discussion. The above question may be considered as a test 
of our understanding of Fathi's ideas. 



6. Automorphisms of Complexes of Curves. The complex of curves 
C{S) of a surface 5 is a simplicial complex defined as follows. The vertices 
of C{S) are the isotopy classes of nontrivial (i.e., not bounding a disk and 
non deformable into the boundary) circles on 5*. A set of vertices forms a 
simplex if and only if they can be represented by disjoint circles. This notion 
was introduced by W. J. Harvey |Haj . Clearly, Mods acts on C{S), and 
this action is almost always effective (the main exception is the case of a 
closed surface of genus 2, where the hyperelliptic involution acts on C{S) 
trivially). If the genus of S is at least 2, then all automorphisms of C{S) 
come from Mods, according to a well-known theorem of the author jl3j, [l6] . 
The problem was to prove the same for surfaces of genus 1 and 0. 

In his 1996 MSU Ph.D. thesis M. Korkmaz proved that all automorphisms 
of C{S) come from Mods ior all surfaces of genus and 1 with the exception 
of spheres with < 4 holes and tori with < 2 holes. See his paper |Kolj . 

Later on, F. Luo |Luo2j suggested another approach to the above results 
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about automorphisms of C{S), still based on the ideas of fTS], and also on a 
multiplicative structure on the set of vertices of C{S) introduced in |Luolj . 
He also observed that Aut(C(S)) is not equal to Mods if is a torus with 2 
holes. The reason is very simple: if 5*1,2 is a torus with 2 holes, and 5*0,5 is 
a sphere with 5 holes, then C(5i,2) is isomorphic to C(5'o,5), but Mod^^ j is 
not isomorphic to Mod^g g. 

So, the problem is solved completely. The theorem about the automor- 
phisms of C(5') had stimulated a lot of further results about the automor- 
phisms of various objects related to surfaces; the proofs are usually based on 
a reduction of the problem in question to the theorem about the automor- 
phisms of C(5'). I will not attempt to survey these results. Instead of this, I 
will state a metaconjecture. 



Metaconjecture. Every object naturally associated to a surface S and hav- 
ing a sufficiently rich structure has Mod^ as its groups of automorphisms. 
Moreover, this can be proved by a reduction to the theorem about the auto- 
morphisms ofC{S). 

7. The First Cohomology Group of Subgroups of Finite Index. 

This is Problem 2.11 (A) in Kirby's list. 



Question. Is it true that H^{r) = for any subgroup T of finite index in 
Mods? 

It is well known that H\Mods) = 0. In his 1999 MSU Ph.D. thesis 
F. Taherkhani carried out some extensive computer calculation aimed at 
finding a subgroup of finite index with non-zero first cohomology group. For 
genus 2 he found several subgroups P with H^(T) ^ 0, but in genus 3 all 
examined subgroups P turned out to have H^{T) = 0. The higher genus 
cases apparently were well beyond the computer resources available at the 
time. See |Tahj . 

J. D. McCarthy |McC2j proved that if 5* is a closed surface of genus > 3 
and P is a subgroup of finite index in Mod^ containing the Torelli subgroup, 
then the first cohomology group H^{r) is trivial. His methods are based on D. 
Johnson results about the Torelli subgroup, the solution of the congruence 
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subgroups problem for S'p2g(Z), g > 3, and the Kazhdan property (T) of 
Sp2g{Z), g>3. 



8. Kazhdan Property (T). This is Problem 2.11 (B) in Kirby's hst. 



Question. Does Mod^ have the Kazhdan property (T)? 



A positive answer would imply the positive answer to the previous ques- 
tion, but this problem seems to be much more difficult. Most of the known 
proofs of the property (T) for discrete groups are eventually based on the 
relations of these discrete groups with Lie groups and on the representation 
theory of Lie groups. Such an approach is not available for Mod^. New 
approaches to the Kazhdan Property (T) (see, for example Y. Shalom |Shalj , 
A. Zuk jZj and the N. Bourbaki Seminar report of A. Valette ^\) hold a 
better promise for our problem, but, to the best of my knowledge, no serious 
work in this direction has been done. 

The problem remains completely open. 



9. Unipotent Elements. This is Problem 2.16 in Kirby's list. 

Let d]Y[-, ■) be the word metric on Mods with respect to some finite set 
of generators. Let t G Mods be a Dehn twist. 



Question. What is the growth rate of dy/{t^i 1)? 



One would expect that either the growth is linear, or 1) = O(logn). 

In the arithmetic groups case, the logarithmic growth corresponds to virtually 
unipotent elements of arithmetic groups of rank > 2, according to a theorem 
of A. Lubotzky, S. Moses and M.S. Raghunathan |LMRj . 

B. Farb, A. Lubotzky and Y. Minsky |FLMj proved that the growth is 
linear, so the problem is solved completely. 



10. Nonorientable Surfaces. Most of the work on the mapping class 
groups is done for orientable surfaces only. Some exceptions are the paper 
of M. Scharlemann jSchaj . and the computation of the virtual cohomologi- 



cal dimension for the mapping class groups of nonorientable surfaces in the 
author's work [Tlj. One may look for analogues of other theorems about 
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Mods' for nonorientable surfaces. For example, what are the automorphisms 
of mapping class groups of nonorientable surfaces? 

Of course, one may expect that some results will extend to the nonori- 
entable case more or less automatically. This applies, for example, to the 
author's results about the subgroups of the mapping class groups reported 
in in]- The only reason why these results are stated only in the orientable 
case is the fact that expositions of Thurston's theory of surfaces exist only 
in the orientable case. But in other problems some new phenomena appear. 
See, for example, the result of M. Korkmaz |Ko2j . jKo3j . N. Wahl |Whaj re- 
cently reported some work in progress aimed at proving a homology stability 
theorem for the mapping class groups of nonorientable surfaces, where some 
new difficulties appear in comparison with the orientable case. 

11. Free subgroups generated by pseudo-Anosov elements. One 

of the first results in the modern theory of the mapping class groups was 
the theorem to the effect that for two independent pseudo-Anosov elements 
(where independence means that their sets of fixed points in the Thurston 
boundary are disjoint) their sufficiently high powers generate a free group 
(with two generators). This observation was done independently by J.D. 
McCarthy and the author and for the author it was the starting point of 
the theory presented in ^J. This result clearly extends to any finite number 
of independent elements and even to an infinite collection of pairwise inde- 
pendent elements, provided that we do not impose a bound on the powers to 
which our elements are raised. Now, what if we do impose a uniform bound? 



Conjecture. /// is pseudo-Anosov element of a mapping class group Mod^ 
with sufficiently large dilatation coefficient, then the subgroup of Mod^ nor- 
mally generated by f is a free group having as generators the conjugates of 
f . More cautiously, one may conjecture that the above holds for a sufficiently 
high power g = f^ of a given pseudo-Anosov element f. 

This conjecture is motivated by a theorem of M. Gromov (see |Grj . The- 
orem 5.3.E). According to this theorem, the subgroup of a hyperbolic group 
normally generated by a hyperbolic element (with sufficiently big translation 
length) is a free group having as generators the conjugates of this element. Of 
course, it is well-known that mapping class groups are not hyperbolic. But, 
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as M. Gromov noticed, what is essential for his proof is not the global neg- 
ative curvature (hyperbolicity), but the negative curvature around the loop 
representing the considered element in an Eilenberg-MacLane space of the 
group in question. So, the hope is that the Teichmiiller spaces have enough 
negative curvature along the axes of pseudo-Anosov elements for a similar 
conclusion to hold. For a more direct and elementary approach to Gromov's 
result see the work of Th. Delzant jHI- 

This conjecture may be relevant to Problem 3 above, since one may expect 
that all nontrivial elements of such subgroups are pseudo-Anosov. 

12. Deep relations. It is well-known that mapping class groups of closed 
surfaces are generated by the Dehn twists (this result is due to Dehn himself, 
see jlTj for a detailed discussion), and that some specific relations among 
Dehn twists, such as the Artin (braid) relations and the lantern relations play 
a crucial role in the proofs of many results about the mapping class groups. 
In fact, according to a theorem of S. Gervais |Gej (a hint to such a theorem is 
contained already in J. Harer's paper [Hj) Mod^ admits a presentation having 
all Dehn twists as generators and only some standard relations between them 
as relations. There is also a similar presentation having only Dehn twists 
about nonseparating curves as generators. See [Gej for exact statements. 
(For surfaces with boundary simple additional generators are needed, but 
the following discussion of the relations between Dehn twists equally makes 
sense for surfaces with boundary.) 

Almost all of these relations disappear if we replace Dehn twists by powers 
of Dehn twists (for example, if we are forced to do so by trying to prove 
something about subgroups of finite index). Apparently, only the relations 

T' n~' n~' — 1 n~' 
a-l-lB-La -Jt<,(/3), 

survive, where Ty for a circle 7 denotes some power t!^ of a Dehn twist 
about 7. We are primarily interested in the case of powers independent 
of circles, since there are no other natural way to assign powers to circles. 
Notice that these relations include the commutation relations T^Tp = Tj^T^ 
for disjoint a,P, and for the circles a,P intersecting once transversely they 
imply the Artin relation tatpta = tptatp. 

Question. Are there any other relations between N-th powers = t^ of 
Dehn twists for sufficiently large N? In other words, do the above relations 
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provide a presentation of the group generated by the N-th powers of Dehn 
twists ? If not, what are the additional relations ? 



13. Burnside groups. Note that the subgroup generated by the A^-th 
powers of Dehn twists is often of infinite index in Mods, as it follows from 
the results of L. Funar |Fu . (See also G. Masbaum |Masj for a simple proof 
of more precise results.) 



Question. Is the subgroup of Mod^ generated by the N-th powers of all 
elements of Mods of infinite index in Mod^ for sufficiently large N? 

Notice that such a subgroup is obviously normal and if it is of infinite 
index, then the quotient group is an infinite Burnside group. 

14. Homomorphisms between subgroups of finite index. In general, 
one would like to understand homomorphisms between various mapping class 
groups and their finite index subgroups. Here is one specific conjecture. 

Conjecture. Let S and R be closed surfaces. Let T be a subgroup of finite 
index in Mods. If the genus of R is less than the genus of S, then there is 
no homomorphism T Modn having as an image a subgroup of finite index 
in Modi?. 

In fact, one may hope that any such homomorphism F — >■ Mod/? has a 
finite image. But while Problem 7 about i^^(F) is unresolved, a more cautious 
conjecture seems to be more appropriate and more accessible, because if 
if^(F) is infinite, F admits a homomorphism onto Z, and therefore, a lot of 
homomorphisms into Modi?, in particular, with infinite image. 

In the special case when F = Modg, the conjecture was recently proved 
by W. Harvey and M. Korkmaz |HaKj . Their methods rely on the use of 
elements of finite order in F = Mod^, and therefore cannot be extended to 
general subgroups F of finite index. 

15. Prattini subgroups. Recall that the Frattini subgroup ^{G) of a 
group G is the intersection of all proper (i.e. different from G) maximal sub- 
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groups of G. According to a theorem of Platonov [FT the Frattini subgroup 
of a finitely generated hnear group G is nilpotent. An analogue of this 
result for subgroups of mapping class groups was proved by the author jTi] 
after some initial results of D. D. Long [L.. Namely, for any subgroup G of 
Mods, its Frattini subgroup ^{G) is nilpotent; see [M], Chapter 10. 

Despite the similarly sounding statements, the theorems of Platonov and 
of the author have a completely different nature. In order to explain this, 
let us denote by $/(G') the intersection of all maximal subgroups of finite 
index in G, and by ^i{G) the intersection of all maximal subgroups of infinite 
index in G; clearly, $(G) = fl It turns out that the main part 

of the argument in jH] proves that ^i{G) is virtually abelian for subgroups 
of Mods (and so is both virtually abelian and nilpotent). At the same 

time, Platonov actually proves that is nilpotent for finitely generated 

linear groups G; subgroups of infinite index play no role in his arguments. 
(Actually, the very existence of maximal subgroups of infinite index in linear 
groups is a highly nontrivial result due to G. A. Margulis and G. A. Soifer 
|MaSoj . and it was proved much later than Platonov's theorem.) 

Conjecture. For every finitely generated subgroups G of Mods, the group 
$/(G) is nilpotent. 

For a more detailed discussion, see jMj, Section 10.10. I repeated here 
this old problem in order to stress that our understanding of the subgroups 
of finite index in Mods is rather limited. 
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